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Abstract — Differential Evolution (DE) is a novel evolutionary 
approach capable of handling non-differentiable, non-linear 
and multi-modal objective functions. DE has been consistently 
ranked as one of the best search algorithm for solving global 
optimization problems in several case studies. This paper 
presents an Improved Constraint Differential Evolution 
(ICDE) algorithm for solving constrained optimization 
problems. The proposed ICDE algorithm differs from 
unconstrained DE algorithm only in the place of initialization, 
selection of particles to the next generation and sorting the 
final results. Also we implemented the new idea to five versions 
of DE algorithm. The performance of ICDE algorithm is 
validated on four mechanical engineering problems. The 
experimental results show that the performance of ICDE 
algorithm in terms of final objective function value, number 
of function evaluations and convergence time. 

Index Terms — Differential Evolution, optimization, 
Mechanical design problems, constraint optimization. 

I. Introduction 

Many real-world optimization problems are solved subject 
to sets of constraints. The search space in COPs consists of 
two kinds of solutions: feasible and infeasible. Feasible points 
satisfy all the constraints, while infeasible points violate at 
least one of them. Therefore the final solution of an 
optimization problem must satisfy all constraints. A 
constrained optimization problem maybe distinguished as a 
Linear Programming Problem (LPP) and Nonlinear 
Programming Problem (NLP). In this paper we have 
considered NLP problems where either the objective function 
or the constraints or both are nonlinear in nature. The general 
NLP is given by nonlinear objective function f, which is to be 
minimized/maximized with respect to the design variables 

x = (x,,x 2 , ,x n ) and the nonlinear inequality and 

equality constraints. This can be formulated by, 

Minimize I Maximize f(x) 



Subject to: gj(x)^0, 7 = 1, ,p 

h k (x) = 0, k=l, ,q 



(1) 



,q (2) 

X imin - X i - X imax C' = L i n ) ■ 

where p and q are the number of inequality and equality 
constraints respectively. There are many traditional methods 
in the literature for solving NLP. However, most of the 
traditional methods require certain auxiliary properties (like 
convexity, continuity etc.) of the problem and also most of 
the traditional techniques are suitable for only a particular 
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type of problem (for example Quadratic Programming 
Problems, Geometric Programming Problems etc). Keeping in 
view the limitations of traditional techniques researchers have 
proposed the use of stochastic optimization methods and 
intelligent algorithms for solving NLP which may be 
constrained or unconstrained. Some examples are: Genetic 
Algorithms [1] - [3], Ant Colony Optimization [4], Chaos 
Optimization Algorithm [5], Particle Swarm Optimization [6], 
Differential Evolution [7] etcetera. Based on the research 
efforts in literature, constraint handling methods have been 
categorized in a number of classes [8] - [10]: 

• Reject infeasible solutions 

• Penalty function methods 

• Convert the constrained problem to an unconstrained 
problem 

• Preserving feasibility methods 

• Pareto ranking methods 

• Repair methods 

In the present research paper we have concentrated our 
work to DE, which is comparatively a newer addition to the 
class of population based search techniques. DE is a 
stochastic, population based search strategy developed by 
Storn and Price [7] in 1995. It is a novel evolutionary approach 
capable of handling no-differentiable, non-linear and 
multimodal objective functions. DE has been designed as a 
stochastic parallel direct search method, which utilizes 
concepts borrowed from the broad class of EAs. The method 
typically requires few, easily chosen control parameters. This 
paper presents an Improved Constraint Differential Evolution 
(ICDE) algorithm for solving constrained optimization 
problems. The structure of the paper is as follows: in section 
II, we have briefly explained the Differential Evolution 
Algorithm, in section III; we have defined and explained the 
proposed ICDE algorithm. Section IV deals with experimental 
settings and test problems, Section V gives the numerical 
results and discussion and finally the paper conclude with 
section VI. 

II. Differential Evolution Algorithm 

DE shares a common terminology of selection, crossover 
and mutation operators with GA however it is the application 
of these operators that make DE different from GA. Whereas, 
in GA crossover plays a significant role, it is the mutation 
operator which effects the working of DE [11]. 
The working of DE maybe described as follows: 
Mutation: For a D-dimensional search space, for each target 

vector X{ lg at the generation g, its associated 
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mutant vector is generated via certain mutation strategy. The 
most frequently used mutation strategies implemented in the 
DE codes are listed below. 

DE/rand/l(Sl): V ig = X hg +F*(X r2>g ~X rjg ) (3) 

DE/rand/2(S2): 

V Ut = *,,, +F*(X r2tg -X r ^ g ) + F*(X^ g -X r$<g ) 

(4) 
DE/best/1 (S3): V ig = X bestg +F*(X ng -X rig ) (5) 

DE/best/2 (S4): 

V,- „ = X h „rt n + F* (X.. „ - X r „) + F* (X, „ - X r „ ) 



1 best,g 



n>g r 2>g' 



*i>g r 4 , 



(6) 



DE/rand-to-best/1 (S5): 

Vi,g ~ X r t ,g + F*(Xbest,g ~ X r 2 ,g ) + F *( X r 3 ,g ~ X r A ,g) 

(7) 

where q,^,^,^,^ e {1,2,...., iVP} are randomly chosen 
integers, must be different from each other and also different 
from the running index i. F (>0) is a scaling factor which 

controls the amplification of the difference vector. X bestg is 

the best individual vector with the best fitness value in the 
population at generation g. 

Crossover: In order to increase the diversity of the perturbed 
parameter vectors, crossover is introduced [12]. The parent 
vector is mixed with the mutated vector to produce a trial 



vector u 



j',g+i 



u i f{rand j <CR) or (j = j mnd ) 

fi - s+1 \ x fi, g if (™d j > CR) and (j * j mnd ) ^ 



V ji,g+l 



where j = 1, 2, , D; rand j e [0,1] ; CR is the crossover 

constant takes values in the range [0, 1] 

and j nmd g (1,2, , D) is the randomly chosen index. 

Selection : Selection is the step to choose the vector between 
the target vector and the trial vector with the aim of creating 
an individual for the next generation. The simple flow of DE 
algorithm is given in Fig 1 . 



Initialize the population 






Calculate the fitne&& value for each 


particle 


Do 






For i= 1 to number of particles 






Do mutation. Cross-over 


and 


Selection 






End for. 






Until Etourjina criteria is. reached. 







Fig 1 Flow of DE algorithm 

III. Proposed ICDE Algorithm 

The proposed algorithm ICDE is a simple algorithm for 
solving constraint optimization problems, it is easy to 
implement. It differs from unconstrained optimization 
algorithm only in the place of initialization, selection of 
particles to the next generation and sorting the final results. 
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The proposed ICDE algorithm uses the mean zero standard 
deviation one normal distribution for initializing the popula- 
tion and uses the following three selection criteria: After cal- 
culating the trial vector (i) If the trial vector and the target 
vector are feasible then select the best one (ii) If both the 
particles are infeasible then select the one having smaller 
constraint violation (iii) If one is feasible and the other one is 
infeasible then select the feasible one. Also at the end of 
every iteration, the particles are sorted by using the three 
criteria: (a) Sort feasible solutions in front of infeasible solu- 
tions (b) Sort feasible solutions according to their fitness 
function values (c) Sort infeasible solutions according to 
their constraint violations. The computational steps of ICDE 
algorithm is given below: 

Step 1 Initialize the population using 

normal distribution with mean zero and 

standard deviation one. 

Step 2 For all particles 

Evaluate the objective function 

Calculate the constraint violation 

End for 

Step 3 While stopping criterion is not 

satisfied 

Do 

Step 3.1 Mutation 

For all particles 

Generate a mutated vector V. 

corresponding to the target vector X ± 

via one of the equations (3) to (7) 

End for 

Step 3.2 Crossover //Generate trial 

vector U. 
For all particles 
Select j rand e {1,...,D} 
For j = 1 to D 

If (rand (0,1) d" CR or j= j ra J 
Then V. = V. 

1,9 1,9 

Else U. = X 

1,9 1,9 

End if 

End for 

End for 

Step 3.3 Selection 

For all particles 

Set X. +1 according to the three selection 

criteria 

End for 

Step 3.4 Sort the particles using the 

three sorting rules 
Step 3.5 Go to next generation 
Step 4 End while 

TV. Experimental Settings and Test Problems 

In order to make a fair comparison of all versions of DE 
algorithms, we fixed the same seed for random number 
generation so that the initial population is same for both the 
algorithms. The population size is taken as 50. The crossover 
constant CR is set as 0.95 and the scaling factor F is set as 
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0.7. For each algorithm, the stopping criteria is to terminate 
the search process when one of the following conditions is 
satisfied: (1) the maximum number of generations is reached 
(assumed 10000 generations), (2) I f - f I < 10^ where fis 

v c 5 ' v ' max mm J 

the value of objective function. A total of 30 runs for each 
experimental setting were conducted. If the run satisfies the 
second stopping condition then that run is called successful 
run. Also we implemented the new idea to five versions of DE 
algorithm. To check the efficiency of the proposed ICDE 
algorithm we have tested it on four optimization problems 
arising commonly in the field of Mechanical engineering. All 
the problems considered here are highly non linear in nature 
and are subject to various constraints. The mathematical 
models of these problems may be given as: 

A. Weight Minimization of a Speed Reducer (WMSR) [13] 

The mathematical model of this problem is, 
Min 

f{x) = 0.7854x 1 x 2 2 (3.3333x 3 2 + 14.9334x 3 -43.0934) 

-1.508x 1 (x 6 2 +x 7 2 ) + 7.477(x 6 3 +x 7 3 ) + 0.7854(x 4 x 6 2 +x 5 x 7 2 ) 
Subject to 

x \ x 2 x 3 — 27 j x^x 2 x 3 > 397.5, x 2 xg x 3 x 4 > 1.93 , 

AyBf 1 <1100 

Where Ai = [(745x 4 x 2 ~ [ xf [ ) 2 + 16.9611 6 ] 05 , B y = 0.1x 6 3 

A 2 B 2 ~ l < 850 

Where A 2 =[(745x 5 x 2 ' [ xf [ ) 2 +15.7510 6 ] - 5 , 

B 2 = 0.1x 7 3 

x 2 x 3 <40, x 1 x 2 _1 >5, x x x 2 X <\2, 1.5x 6 -x 4 <-1.9, 
1.5x 7 -x 5 <-1.9. 

2.6 < x x < 3.6 , 0.7 < x 2 < 0.8 , 17 < x 3 < 28 , 

7.3 < x 4 < 8.3 , 7.3 < x 5 < 8.3 , 2.9 < x 6 < 3.9 , 5 < x 7 < 5.5 

B. Heat Exchanger Network Design (HEND) [14] 

The mathematical model is, 
Minimize /(x) = x x + x 2 + x 3 
Subject to 
-1 + 0.0025(x 4 + x 6 ) < , -1 + 0.0025(x 5 + x 7 - x 4 ) < , 

-l + 0.01(x 8 -x 5 )<0 

-x v x 6 +833.33252x 4 + 100x1-83333.333 < 0, 

-x 2 x 7 + 1250x5 + x 2 x 4 - 1250x4 < , 

-x 3 x 8 + 1250000+ x 3 x 5 - 2500x 5 < 0, 

-100 <x x < 10000 , 1000 < x,. < 10000 (i = 2,3) , 



,!iH> 



-lim 



600 



100 



111 



ll 



^+ 



I; 



X-. 



Nil 



Fig 2 Heat Exchanger Network Design Problem 

C. Gas Transmission Compressor Design (GTCD) [15] 
The mathematical model is, 

/(x) = 8.61 xl0 5 x 1 1/2 x 2 x 3 _2/3 x 4 _1/2 + 3.69 xl0 4 x 3 

+ 7.72 xl0 8 xf 1 x 2 - 219 -765.43 xl0 6 xf 1 
Subject to 

-2 -2^i 

Xa Xn 1 Xn -^ J- 

20 < xj < 50 , 1 < x 2 < 10 , 20 < x 3 < 50 , 0.1 < x 4 < 60 

D. Optimal Design of Industrial refrigeration System (ODIRS) 
[16] 

The mathematical model is, 

/(x) = 63098.88x 2 x 4 x 12 +5441.5jc 2 2 jc 12 + 115055.5jt 2 lf>64 x 6 
+ 6172.27 x 2 2 x 6 +63098.88x 1 x 3 x 11 +5441.5x 1 2 x 11 



-HSOSS.Sx/^Xj +6172.27x! 2 x 5 +140.53XJXH 
■281.29x 3 x n +70.26xl 2 +28 1.29^X3 +281. 29x 3 2 



-14437x 



1.8812 0.3424 



-12, 

Xi (\X\A Xt Xn X, 



10 A 14 A l A 7 A 9 



2.893 0.316 2 



+ 20470.2x 7 -- -x u 
Subject to 

1 .524x 7 ~' < 1 , 1 .524x 8 ~' < 1 , 0.07789^ - 2x 7 ~'x 9 < 1 , 

7.05305x 9 Xj x 10 x 8 x 2 x 14 < 1 , 0.0833x 13 x 14 < 1 , 

ah \ic 0-333 -1 , ,„ 2.1195 

47.136x 2 x m x 12 -1.333x 8 x 13 

+ 62.08x 13 ' x 12 x 8 ' Xiq ^1> 

„„.„„, 1.8812 0.3424 , , 

0.0477 lx 10 x 8 x 12 <1, 



nn/ico 1.893 0.316 ^, 

0.0488x 9 x 7 x n <1 , 



-1 



0.0099x^3 l < 1 , 



0.0193x 2 x 4 * < 1 , 0.0298x^5 l < 1 , 0.056x 2 x 6 * < 1 



-1 



-1 



-1 
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2xg <1, 2x m <1, X 12 Xjj <1, 

0.001 <x, <5, / = 1,...,14 

V. Experimental Results and Discussion 

Tables I - IV gives the numerical results given four real 
life constrained optimization problems. These problems occur 
frequently in the field of mechanical designs. The comparison 
criteria for the algorithms is done in terms of best, average 
and worst fitness function values, NFE, std, SR and time. For 
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all the algorithms, NFE represents the number of function 
evaluations, which helps in determining the convergence of 
the algorithm. Lesser value of NFE implies faster convergence, 
std represents the standard deviation which tells the stability 
of the algorithms. Smaller std implies that the algorithm is 
more stable. SR represents the success rate, which signifies 
the efficiency of an algorithm. It tells us how many times the 
algorithm was able to converge successfully within 1 % of the 
true global optima. For all the problems we compared our 
results with those available in literature. Form Tables I to IV, 
the 



results obtained by the different DE versions and the ones 
available in literature are given. From the numerical results it 
is quite visible that the versions of DE gave better results 
than the ones available in literature. In terms of best, average 
and worst fitness function values all the algorithms gave 
more or less similar results. However in terms of NFE, SR and 
time taken, the algorithms showed different behavior. 



Table I comparison RE suits of WM5R 



Item 


DE rand 1 


DE rand'2 


DE'best'l 


DE best I 


DE rand- 
to-best 1 


Result in [13] 


Best 


2863.36 


2863.36 


2863.36 


2863.36 


2863.36 


2994.47 


Average 


2S63.36 


2S63.36 


2S75.2S 


2S66.52 


2SS1.15 


-NA- 


Worst 


2S63.36 


2S63.36 


3022.43 


2902. S9 


2922.53 


-NA- 


Std 


1.56e-Q5 


l.S4e-05 


32.1611 


10.7244 


20.139S 


-NA- 


NFE 


9112 


19232 


3S02 


745S 


3672 


-NA- 


SR 


100% 


100% 


100% 


100% 


100% 


-NA- 


Time (sec) 


1.44 


3.16 


0.52 


1.0S 


0.4S 


-NA- 


Table II comparison results of hend 


Item 


DE/iand/1 


DE'rand'2 


DE'best/l 


DE/b est/2 


DE rand- 
to-best 1 


Resultin [14] 


Best 


7049.25 


7049.25 


704925 


7049.25 


7049.25 


7049.25 


Average 


7049.25 


704925 


706724 


7049.25 


7049.25 


-NA- 


Worst 


7049.25 


704925 


7373.79 


7049.25 


7049.25 


-NA- 


Std 


6.17e-05 


3.33e-05 


63.401 


125e-05 


1.45e-05 


-NA- 


NFE 


S6316 


3S133S 


6759S 


194S26 


277594 


33146 


SR 


100% 


100% 


96V* 


100% 


100% 


B8% 


Time (sec) 


0.16 


0.76 


0.16 


0.4 


0.4S 


1292 


Table ill comparison results of gtcd 


Item 


DE-rand' 1 


DErand'2 


DE best 1 


DE/b est/2 


DE rand-to- 
b est/1 


Result in [15] 


Best 


2.963e+Q6 


2.963e+06 


2.963e+06 


2.963e+06 


2.963e+06 


2.99e-06 


Average 


2.963 e-06 


2.963 e-06 


2.963e-H)6 


2.963e-06 


2.963e-06 


-NA- 


Worst 


2.963e-06 


2.963 e-06 


2.963e-06 


2.963e-06 


2.963e-06 


-NA- 


Std 


S.79e-06 


7.99 e-06 


3.17 e-06 


4.S5e-06 


6. OS e-06 


-NA- 


NFE 


14634 


2S43 


6640 


1S610 


232S4 


-NA- 


SR 


100% 


100% 


100% 


100% 


100% 


-NA- 


Time (see) 


0.56 


1.0 


02S 


0.64 


0.S4 


-NA- 


Table i y comparison re suits, of odirs 


Item 


DE'randT 


DE/rand/2 


DE'best/l 


DE'b est/2 


DE rand- 
to-best 1 


Resultin [16] 


Best 


13646.5 


27275.6 


13646.6 


13651.9 


14399.6 


19230 


Average 


13646.5 


34972 


142S2.5 


13660. S 


15336.5 


-NA- 


Worst 


13646.5 


4090S.S 


17323.3 


136S3 


1S166.6 


-NA- 


Std 


7.B2e-Q5 


5557.24 


1 1 is.es 


10.4135 


777.945 


-NA- 


NFE. 


316526 


500050 


185504 


500050 


500050 


-NA- 


SR 


100% 


0% 


96% 


0% 


0% 


-NA- 


Time (sec) 


92.72 


150.64 


56.16 


220.04 


157. OS 


-NA- 
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The first problem is involves the design of a speed reducer 
for small aircraft engine. It has a nonlinear objective function 
and it consists of eleven inequality constraints and seven 
unknown variables. For this problem all the DE versions gave 
same results in terms of best, worst and average fitness 
function values. If we compare the NFC and convergence 
time then DE/rand-to-best/1 is better than all other versions. 
The second problem addresses the design of a heat exchanger 
network as shown in Fig 2. It has three equality constraints, 
three inequality constraints and eight decision variables. For 
this problem also all the algorithms gave same result in 
comparison best fitness function value. In comparison of 
average fitness value DE/best/1 gave slightly worse value 
than other algorithms. But in terms of convergence time it is 
better than all other versions. The third problem is a gas 
transmission compressor design problem. For this problem 
DE/best/1 gave better result in terms of standard deviation, 
NFE and convergence time. DE/rand/1 gave better result 
than other algorithms in terms of best fitness function value. 

VI Conclusion 

In this paper, we proposed an Improved DE algorithm 
called ICDE for solving constrained optimization problems. 
ICDE differs from the basic DE in the initialization, selection 
and sorting phases. These modifications are embedded on 
various versions of DE and their efficiency is validated on a 
set of four real life engineering design problems, occurring 
frequently in the field of mechanical engineering. We would 
like to add that in the present article though we have 
considered only four problems, the preliminary numerical 
results obtained, show that the proposed modifications are 
beneficial for solving constrained optimization problems 
effectively. Moreover, this is a general technique/ modification 
and can be applied to any population based search technique 
like Genetic Algorithms, Particle Swarm Optimization etc. 
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